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(54) Display optimization for night vision enhancement systems 

based upon the horizontal dimension of the field of view 
of the infrared sensor (11) such that the display aspect 
ratio decreases as the horizontal field of view narrows. 



(57) Night vision apparatus (11.21, 23) including an 
infrared night vision sensor (11) having a selected field 
of view and a display panel (23) positioned for display- 
ing an image detected by the sensor (11), the display 
panel (23) having a display aspect ratio optimized 
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Description 

BACKGROUND OF THE INVENTION BEST AVAILABLE COPY 

5 1. Field of the Invention 

The subject invention relates to night vision systems and, more particularly, to a method and apparatus for optimiz- 
ing display size and perlormance in such systems. 

10 2. Description of Related Art 

Night vision systems have recently been designed for use in connection with passenger vehicles and marine ves- 
sels. Such systems are disclosed, for example, in U.S. patent applications Serial Nos. 08/226.728. filed April 12. 1994 
(Atty. Dkt. No. PD-94072) and the continuation-in-part thereof (Atty. Dkt. No. PD-94058). entitled "LOW COST NIGHT 

is VISION ENHANCEMENT SYSTEM FOR MOBILE LAW ENFORCEMENT APPLICATIONS" and "LOW COST NIGHT 
VISION SYSTEM FOR MOBILE LAW ENFORCEMENT AND MARINE APPLICATIONS/ the disclosure of such appli- 
cations being incorporated by reference herein. Such systems employ an externally-mounted night vision sensor (infra- 
red camera) and a display, which is typically mounted within the vehicle or marine vessel for displaying the external 
scene to the operator of the vehicle or vessel. 

20 Prior to the subject invention, vehicles modified for night vision enhancement have utilized a standard 4:3 aspect 
ratio display, regardless of the sensor (camera) field of view. Such a fixed field of view has several drawbacks. In gen- 
eral, the display provides excess information which may confuse the driver. Depth perception may be skewed with the 
result that the driver cannot judge distances, for example, the distance to a vehicle being followed. Such problems are 
particularly acute in applications where the system magnification is less than 1 . a condition which is desirable to reduce 

25 display size to the size required to fit typical automobile and other applications. 

OBJECTS AND SUMMARY OF THE INVENTION 

Accordingly, it is an object of the invention to improve night vision systems; 
30 It is another object of the invention to improve displays used in conjunction with night vision systems; 

It is another object of the invention to provide a night vision system display with improved depth perception; and 
It is another object of the invention to provide a night vision system display with improved information conveying 
capabilities. 

According to the invention, a night vision system display is provided wherein the display and sensor field of views 
35 are optimized for night vision enhancement. A relationship is established according to the invention between the 
selected sensor field of view and the display aspect ratio implemented in response to that selection for a particular loca- 
tion of the sensor on the vehicle. According to this relationship, the display aspect ratio decreases as the selected field 
of view narrows so as to provide only as much information as the operator or driver normally sees out of the windshield 
with the naked eye. Thus, the vertical field of view of the display subtended at the driver's eye is selected to present only 
40 useful information to the driver, and the road area directly in front of the vehicle, for example, is eliminated from the field 
of view, since it provides no useful information and, in fact, can distract the eye due to the high rate of motion. Depth 
perception is improved, since excess vertical information in the display, which distorts the driver s depth perception, is 
also eliminated. The amount of time required by the driver to assimilate the information provided in the display is also 
reduced, further improving assimilation of the display by the driver. 

45 

BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and features of the present invention, which are believed to be novel, are set forth with particularity in 
the appended claims. The present invention, both as to its organization and manner of operation, together with further 
so objects and advantages, may best be understood by reference to the following description, taken in connection with the 
accompanying drawings. 

FIG. 1 is a schematic perspective view illustrating a night vision enhancement system wherein the preferred 
embodiment finds application; 
55 FIG. 2 is a schematic diagram illustrating an optical system according to the preferred embodiment; and 
FIG. 3 is a perspective view illustrating an optimized display panel according to the preferred embodiment. 
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nFTAII Fn DESCRIPTION OF THE PREFE RRED EMBODIMENTS 

The following description is provided to enable any person skilled in the art to make and use the invention and sets 
forth trie best modes contemplated by the inventor of carrying out his invention. Various modifications, however, will 
5 remain readily apparent to those skilled in the art. since the generic principles of the present invention have been 
defined herein specifically to provide readily manufacturable and implemented commercial embodments. 

FIG. 1 is a schematic diagram illustrating an illustrative installation of a low cost night vision enhancement system 
in a public safety vehicle (shown in phantom). The system 1000 includes a night vision camera 1 mounted in a pointing 
mechanism 500 on top of a public safety vehicle 1010 (shown in phantom). The night vision camera 1 and the pointing 
>o mechanism 500 are secured to the top of the vehide 1010 by suitable mounting hardware 1012 (not shown). 

As further shown in FIG. 1 . the night vision camera 1 is connected to a display unit which, in the illustrative embod- 
iment may implemented as a "Datavision" head-up display (HUD) available from Hughes Aircraft Company. The Data- 
vision HUD includes a projector 587. a combiner 1030, display electronics 1040 located in the trunk, and data harness 
and power harness cables 1038, 1039. The combiner 1030 is mounted on the windshield 1032 (shown in phantom) of 
the vehicle 1010 for displaying a real image from the projector 587. The cables 1038, 1039 are shielded and are stowed 

in suitable mounting brackets. ...... /, , , „rm 

The video display is not limited to a Datavision HUD. Alternatively, an active matrix liquid crystal display (LCD) 
mounted on the dashboard of the vehicle can be used to display the real image from the camera. Active matrix LCDs 
are available from Citizen, Sharp, and Toshiba, to name a few. 

Instead of displaying a real image, the video/display can display a virtual image. The virtual .mage can be displayed 
by "Virtual image Glasses" available from Virtual Vision in Redmond. Washington. The Virtual Image Glasses project 
a TV-like wide screen image in front of the bumper of the vehicle. An officer wears the Glasses to view the scene 
ahead Data is transmitted either through hard-wired connections or wireless (e.g., spread spectrum) transmission from 
the camera to the Glasses. Instead of the Glasses, a helmet-mounted visor can be used to project the TV-like, wide 
25 screen image in front the bumper of the vehicle. 

Alternatively, a virtual image can be displayed directly on the vehicle windshield by the virtual display disclosed and 
claimed in European Patent Application Mo. EP-A-0596729. entitled VIRTUAL IMAGE INSTRUMENT PANEL DISPLAY 
and assigned to the assignee of the present invention. This system, which includes mirrors and an active matrix LCD - 
as a source can be installed at the vehicle manufacturer, or it can be installed as an attermarket add-on. 
so The system 1000 is controlled by a remote control unit 566 mounted inside the vehicle 1010. In the preferred 
embodiment the remote control unit 566 is implemented with a joystick 568 and a plurality of switches 572. The camera 
1 remote control 566 and the projection unit are interconnected by the data harness cable 1 038 and a power harness 
cable 1039 to display electronics 1040 located in the trunk of the vehicle 1010. Further details of the vision enhance- 
ment system 2 may be had by reference to the aforementioned U.S. patent applications, herein incorporated by refer- 

35 6I1CG 

FIG 2 schematically illustrates an optical system 13 employing an infrared sensor 11, such as camera 1 used in 
the night vision enhancement system of FIG. 1. The optical system 13 focuses equally-spaced points 15 along a road- 
way 17 onto a focal plane array 19. As disclosed in the afore-mentioned patent applications, the focal plane array 19 
may be an array of uncooled detectors from which an image is ultimately supplied via suitable cables 21 to a display 23. 

The optical system 1 3 of FIG. 2 is a wide-angle optical system, i.e.. one that includes both near and far field points 
out in front of the vehicle 1010. In sue* a system, equally-spaced points in object space are nonlinearly distributed on 
the focal plane array 19. This nonlinear distribution of chief optical rays creates a misjudgment of distance in the dnver s 
mind Analyzing the system of FIG. 2. one sees that, as the sensor field of view narrows in the horizontal dimension, 
the display aspect ratio must decrease to present the same amount of vertical information to the driver (i.e a constant 
45 vertical field angle). Thus, in a series of photographs of the same vehide with varying lens angles, judging how far away 
the vehicle is becomes progressively more difficult as the lens angle becomes wider and wider. There is so much extra- 
neous information in the scene that the observer loses the ability to relate the displayed image to the real workUn addi- 
tion although the size of the vehicle becomes progressively smaller as the lens angle widens, the driver sees basically 
the same relative "distance" in each view. The foregoing assumes the size of a vehide is relatively known to any dnver. 
so The foregoing analysis demonstrates the inherent relationship between sensor and display fields of view. This rela- 
tionship is quantified empirically in the following table, where "HFOV" indicates horizontal field of view: 
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TABLE I 



SENSOR HFOV 
(DEGREES) 


OPTIMUM DISPLAY 

ASPECT RATIO 
(HORIZONTAL TO 
VERTICAL) 


58 


5:2 


33 


4:2 


27 


5:3 


16 


4:3 



All aspect ratios given in Table I are tor an 8.5-inch horizontal width display viewed at approximately 30 inches with the 
camera/sensor mounted on the roof of a vehicle, as shown in FIG. 1. Once the display aspect ratio is optimized for 
depth perception, the system designer can be assured that the absolute minimum amount of displayed information has 
been presented to the driver. Such optimization reduces to displaying only as much information as the driver normally 

20 sees through the windshield with the naked eye. 

It is also considered desirable by the inventor to minimize the number of eye fixations required to view the display 
23. It is known in the art of designing and integrating avionics displays into aircraft that the number of eye fixations 
required to assimilate information from a display is directly proportional to angular area. A good rule of thumb is that 
one eye fixation is composed of up to three fine eye movements or saccades. and that each saccade provides useful 

25 information over a five-degree angular (circular) area. Thus, minimizing the number of eye fixations is desirable for 
safety and efficiency in a display for aircraft, automobiles, trucks, recreational vehicles, or any other form of moving 
apparatus. The preferred embodiment minimizes the number of eye fixations by minimizing the amount of displayed 
information the viewer must deal with. 

Also, the importance of the overall system magnification between an object in the real world and an object as 

30 viewed on the display should be noted. The system magnification may be computed as follows: 

system mag = — 

35 

where 

e 0 = angular subtense of feature in object space 

e D = Angular subtense of feature as viewed on display at the driver's eye position 

40 

.„.«.-($) 
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A = linear dimension of displayed feature, inches 
B = distance of eye to display, inches 

so Given the above relationships, it is noted that a system magnification which is less than 1 creates a problem in judg- 
ing depth in the display 23. If the system magnification were always held to the value "1 the field of view of the sensor 
1 1 would not matter. This, however, requires a very large display 23 for wide field angles in the sensor 1 1 . Since a large 
display is impractical to package in many vehicles, the relationships described herein become very useful when a wide 
field angle is desired for the horizontal field of view of the sensor 1 1 . 

55 In a particularly preferred embodiment constructed according to the invention, the field of view of the sensor 1 1 is 
27 degrees horizontal and 9 degrees vertical. With a mean distance 22 from the display 23 to the driver's eye 24 of 30 
inches and an image magnification of .5:1 . the display aspect ratio is selected at 3:1 . resulting in a display 23 which is 
7.2 inches in width (horizontal) and 2.4 inches high (vertical), as shown in FIG. 3. The display 23 is placed directly in 



EP0 742 480 A2 



front of the driver, in place of the normal automobile instrument panel cluster, although this is by no means the only pos- 
sible location for the display 23. 

The above teachings are thought to apply to all forms of displays possible in a vehicle. Flat panels, CRTs, projected 
or direct view may be implemented in this fashion, regardless of display location in the vehicle. Any empirically-derived 

5 relationship between aspect ratio and sensor or camera field of view (if the camera is visible) will change to some 
degree as the sensor or camera perspective with respect to the driving "scene" in front of the vehicle changes. A gen- 
eral formula has not been derived to date, though one could readily be derived geometrically with applied trigonometry. 
The important consideration in the selection of display aspect ratio (in this case 3:1) is to avoid overwhelming the driver 
with extraneous information in the vertical field. Therefore, the wider the horizontal field of view of the sensor is. the nar- 

70 rower the display vertical dimension becomes. 

A degree vertical field of view is optimal in the preferred embodiment, as determined through empirical testing. 
In preferred installation, a particular objective was to reduce the amount of time the driver's eyes were off the view 
through the windshield and on the cfisplayed image. 

Those skilled in the art will appreciate that various adaptations and modifications of the just<Jescnbed preferred 

is embodiment can be configured without departing from the scope and spirit of the invention. Therefore, it is to be under- 
stood that, within the scope of the appended claims, the invention may be practiced other than as specifically described 
herein. 
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Claims 



1. A method of optimizing the scene presented to a viewer by a system employing a sensor (11) including a wide 
angle optical system (13) and a visual display (19) comprising the steps of: 

arranging said sensor (1 1) to have a field of view of a selected horizontal dimension: and 
selecting a display aspect ratio for said display (13) based on said horizontal dimension. 

2 The method of Claim 1 wherein said sensor (1. 1 1) is mounted above a windshield ((1032) and said display aspect 
ratio is selected according to a relationship whereby said display aspect ratio decreases as said honzontal dimen- 
sion narrows so as to provide only as much information as a viewer sees out of the windshield (1032) with the 
30 naked eye (24). 

3. The method of Claim 2 further including the step of selecting the vertical field of view of said sensor (1 1 ) to be 9 
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4. The method of Claim 3 further including the step of selecting the horizontal field of view of said sensor (1 1 ) to be 
27 degrees. 

5 The method of Claim 4 further including the step of selecting the mean distance (22) from the display (23) to the 
viewer s eye (24) to be 30 inches, the system image magnification to be .5:1 , and the display aspect ratio to be 3:1 

6. The method of Claim 2 further including the step of selecting the display aspect ratio in accordance with the follow- 
ing table, where HFOV indicates horizontal field of view: 



SENSOR HFOV 
(DEGREES) 


SELECTED DIS- 
PLAY ASPECT 
RATIO (HORIZON- 
TAL TO VERTICAL) 


P 58 


5:2 


33 


4:2 


27 


5:3 


16 


4:3 
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(54) Display optimization for night vision enhancement systems 



(57) Night vision apparatus (11.21, 23) including an 
infrared night vision sensor (11) having a selected field 
of view and a display panel (23) positioned for display- 
ing an image detected by the sensor (11). the display 
panel (23) having a display aspect ratio optimized 
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based upon the horizontal dimension of the field of view 
of the infrared sensor (1 1) such that the display aspect 
ratio decreases as the horizontal field of view narrows. 
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